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What is this study about? 

This study examined the effects on academic 
achievement of offering students enrollment in the 
Promise Academy charter middle school. The school 
is sponsored by the Harlem Children’s Zone®, which 
combines reform-minded charter schools with a web 
of community services designed to provide a positive 
and supportive social environment outside of school. 

The study analyzed data on about 470 New York 
City students who applied for enrollment in 2005 
and 2006 as entering sixth graders. The number 
of applicants exceeded the school’s capacity, so 
enrollment offers were granted by random lottery. 

The study measured effects by comparing the out- 
comes of students who were selected in the lottery 
and offered enrollment in the school to students 
who were not selected in the lottery. 

Student outcomes were measured in sixth, seventh, 
and eighth grades using standardized statewide math 
and English language arts (ELA) tests. 


WWC Rating 


The research described in this 
report is consistent with WWC 
evidence standards 

Strengths: The study is equivalent to a randomized 
controlled trial because the groups of students 
contrasted In the study were formed by random lottery. 


Features of the Promise Academy Middle School 


Charter school sponsored by the Harlem Children’s 
Zone® 

Extended school day and year with additional 
after-school tutoring and Saturday classes 

Intensive test preparation including morning, mid-day, 
after-school, and Saturday sessions 

Student incentives for high achievement, such as 
money and trips to France 

School health clinic provides students free medical, 
dental, and mental-health services 

What did the study authors report? 

Students offered enrollment in the school had 
higher math test scores in sixth, seventh, and 
eighth grades than the students not offered 
enrollment. By the time they were tested in eighth 
grade, the effect size for the math test was 0.55. 

The WWC interprets this as equivalent to moving a 
student from the 50th to the 71 st percentile. 

The study authors found no statistically signifi- 
cant differences in ELA test scores in sixth or sev- 
enth grade, but a positive effect was found on the 
eighth grade ELA test. The effect size was 0.19, 
which the WWC interprets as equivalent to moving 
a student from the 50th to the 58th percentile. 


t Dobbie, W., & Fryer, R. G., Jr., (2009). Are high-quality schools enough to close the achievement gap? Evidence from a social experiment in Harlem. 
(NBER Working Paper No. 15473). Cambridge, MA: Nationai Bureau of Economic Research. 
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